Categories
from token to chatbot
2 articles
-
Attention: How Words Talk to Each Other
Part 2 of the series 'From Token to Chatbot'. The attention mechanism explained with zero math background required: dot product, softmax and the Query/Key/Value trio, with hands-on Python to watch a model link 'it' to 'cat'.
Read more -
How an LLM Builds a Word
An LLM does only one thing: predict the next word, over and over. Part one of the series 'From Token to Chatbot' — tokens, embeddings, logits and softmax, with hands-on Python to watch GPT-2 hesitate and then pick 'Paris'.
Read more